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CONTINUOUS LUNCHES ARE NOT FREE 


Michael D. VoseEl 

Abstract. Stemming from a paper of Auger and Teytaud, there is a common misconception that 
for continuous domains No Free Lunch (NFL) does not hold [Tj. However, Rowe, Vose, and Wright 
have demonstrated that NFL holds for arbitrary domains and co-domains [2]. This paper resolves the 
apparent contradiction. 
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1 Introduction 


The No Free Lunch (NFL) Theorem as introduced by Wolpert and Macready [3] originally dealt 
with Black-box optimization of functions mapping a finite domain A to a finite co-domain y. It 
has since been refined and generalized to arbitrary X and y [2] and roughly speaking says: All 
Black-box optimization algorithms perform on average equally well over a set F of functions if and 
only if F is closed with respect to permutation. 

In contrast, the paper of Auger and Teytaud [I] concludes that NFL does not hold for continuous 
domains. As demonstrated below, their conclusion follows from their imposition of the artificial 
constraint - which is unnecessary for NFL - that functions under consideration be measurable. 


2 Measurability and Permutation Closure 


Theorem 1 Let F be a set of Borel measurable functions whose members have type f : [0,1] M. 
If F is permutation closed and f € F, then f is constant almost everywhere. 


Proof: Suppose there exists / G F and q £ R such that both inverse images / 1 (—oo, q] 
and / _1 (g, oo) have nonzero Lebesgue measure. Define g as 

a( x ) = f 1 ifx>q 

' \ 0 otherwise 


and let h = g o f. It follows that h : [0,1] —> {0,1} is Borel measurable, and both 
preimages Co = h -1 {0} and C\ = h -1 {l} are disjoint and uncountable. Let S C [0,0.5] 
be a nonmeasurable set; both S and [0,1] \ S are therefore uncountable. Let a be a 
bijection o : S —> C\ and extend a to a bijection on [0,1] such that a : [0,1] \ S —> Co. 
Note that 


h o a(x) 


1 if x € S 
0 if x € [0,1] \ S 
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In other words, h o a is the indicator function I 5 : [0,1] —> {0,1} of the nonmeasurable 
set S. In particular, I 5 is not Borel measurable. However, 


Is = ho a = gofoa = gof 

were f' = foa€.F (F is permutation closed). Because F contains Borel measurable 
functions, it follows that I.s = g 0 f' is Borel measurable, which is a contradiction. 

Therefore, for all f € F and q G M, at least one of 

Lg = / _1 (-oo, q], U q = / _1 (g, 00 ) 

has Lebesgue measure zero. Let A(-) denote Lebesgue measure. Note that A (L q ) = 
A (U q ) = 0 is impossible, since 1 = A([0,1]) = A (L q U U q ) = A (L q ) + A (U q ). Note that 

[0,1] = / _1 M = / _i y(-oo,g] = |J/ _1 (-oo,g] = |J L q 

q€jj gEZ q€Jj 


Hence there exists q' € Z such that A (L q /) > 0 and A (U q i) = 0. Similarly, 


[0,1] = / 1 (J(g,oo) = U U i 

q&I q&h 


Hence A (U q *) > 0 and A (L q *) = 0 for some q* € Z. In particular, q* < q'. Let £q = q*, 
uq = q' and note that X(f~ 1 [lo,uo\) = 1. Define a nested sequence of closed intervals 

\£--i • 'U j i\ D [^j_|_i, Uj-|_i] 


by 


m = {£i + Ui )/2 


[A+l) ^i+l] 


[£i,m] if \{U m ) = 0 
[m,Ui\ if A(L m ) = 0 


It follows that A(/ 1 [£i,u/\) = 1 for all i, 


{c} = P| [£i,Ui\ 
i =0 

for some c € M, and A(/ - 1 {c}) = 1. In particular, / is constant almost everywhere. □. 


The previous theorem makes clear how the the artificial constraint that functions be measurable 
prevents NFL; if I 7 is a collection of non-trivial (i.e., not constant a.e.) measurable functions, then 
F cannot be permutation closed! 

It could be mentioned that Auger and Teytaud [1] impose additional artificial constraints. However, 
measurability is enough to trivialize NFL. 
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